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DETAILED ACTION 

Response to Arguments 

Applicant's arguments filed 6/25/07 have been fully considered but they are not 
persuasive. On page 1 1 of the applicant's remarks, the applicant argues that Zickler 
teaches capturing more than one pair of Helmholtz reciprocal pair of images. The 
applicant argues that this does not anticipate 1-4 and 30-32. The examiner notes that 
these claims recite "obtaining a Helmhotz reciprocal pair of images...". This claim 
language does not exclude the ability to capture more than one pair of images. 
Therefore, the rejection stands. 

The 101 rejections are withdrawn. 

Claims 31 and 34 are cancelled. 

Please see final rejection below. 



Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 
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Claim 1-4 and 30-32 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Zickler et al. (referred to as "Zickler" herein. Article titled "Helmholtz Stereopsis: 
Exploiting Reciprocity for Surface Reconstruction") 

Regarding claim 1 , Zickler discloses a method of image reconstruction 
comprising: obtaining a Helmholtz reciprocal pair of images of an object aidd Helmholtz 
reciprocal pair of images comprising a first image and a corresponding reciprocal 
image; (see section 1 titled "introduction and section 4, subsection "Capturing 
Reciprocal Images." Here Zickler discloses capturing helmholtz reciprocal images). 

determining a geometry associated with said obtaining of said Helmholtz 
reciprocal pair of images (see page 877-879. section titled "using the matching 
constraint as it discloses determining the surface geometry of the images. Specifically 
see the last paragraph on page 878.); 

selecting a plurality of points in said first image and identifying corresponding 
candidate points in said corresponding reciprocal image (see the second paragraph on 
page 878 as it discloses finding characteristics of a point Q and using the characteristics 
of the points to create a depth map); 

matching a selected point of said plurality of points and a candidate point of said 
corresponding candidate points (the system must match the points in order to create the 
depth map because the system needs both images to create the depth map. See 
pages 878-879 for more information). 

Regarding claim 2, Zickler discloses capturing a first image of said image pair 
with a first receiver at a first optical center and a first source at a second optical center; 
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and capturing a second image of said image pair with at least one of said first receiver 
and a second receiver at said second optical center, and at least one of said first source 
and a second source at said first optical center (figures 1 , 5 and pages 876-877 
discloses using a light source and receiver that are placed on a wheel. Page 871 , 
paragraph starting with "Before describing Helmholtz stereopsis,...." Discloses that the 
light source is centered) 

Regarding claim 3, the rejection of claim 2 discloses all aspects of claim 3. 

Regarding claim 4, please see the rejection of claim 4 and also page 878 as it 
discloses calculating the epipolar plane based on the helmholtz reciprocal images. 

Regarding claims 30-32, please see the rejection of claim 1 above. 
Claim Rejections * 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

1 . Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Zickler in 

view of Gerig et al. (5446548, referred to as "Gerig" herein). 

Regarding claim 5, Zickler does not explicitly disclose the specifics of using 

epipolar lines. However he does disclose using epipolar planes and creating depth 

maps. 

Gerig discloses selecting an epipolar line in s^aid first image and a corresponding 
epipolar line in said corresponding reciprocal image based on an epipolar geometry; 
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selecting an adjacent pair of points on said epipolar line in said first image of said 
reciprocal pair of images; applying an ordering principle based on said adjacent pair of 
points; and selecting a candidate matching point on said corresponding epipolar line in 
said corresponding reciprocal image (see column 5 lines 19-43 as it discloses a 
hierarchical matching process by using epipolar lines). 

It would have been obvious at the time of the invention to one of ordinary skill in 
the art to combine in Zickler the specifics of epipolar lines as taught by Gerig. The 
reason for the combination is because it makes for a more robust system that allows the 
system to match points from one image to another. Further, both inventions are from 
the same field of endeavor of finding geometric relationships between images. 

2. Claims 6-13 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Zickler in view of Tu et al. (Paper titled, "Surface Reconstruction via Helmholtz 
Reciprocity with a Single Image Pair. This paper has a publication date of June 2003 
and will be referred to as "Tu" herein). 

Regarding claim 6, please see the rejection of claim 1 and page 872 of Zickler as 
it discloses using depth, intensity and finding the normal. Please take special note of 
equation (1). 

Zickler does not explicitly discloses refining prediction error based on the above 
information. 
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Tu discloses refining a prediction error (see abstract and page 1. paragraph 
starting with "By swapping the positions..." , and figure 1 as it discloses predicting and 
refining the prediction error based on the intensity response. 

It would have been obvious at the time of the invention to one of ordinary skill in 
the art to include in Zickler a prediction and refinement method as taught by Tu. The 
reason for the combination is because it allows for a system that can more accurately 
reconstruct the data. Further, both invention deal with Helmholtz image reconstruction. 

Regarding claim 7, equation 1 of Zickler discloses the equation as claimed. Also, 
equation (3) of Tu discloses the equation as well. 

Regarding claim 8, please see page 883, third paragraph, of Zickler as it disclose 
that the BRDF can be taken Into account. 

Regarding claim 9, please see page 882 of Zickler as it discloses that no 
assumption about the BDRF. 

Regarding claim 10-11, please see section 3 of Tu as it discloses taking into 
account specularities and shadows and occlusions. 

Regarding claim 12, section 3.2 of Tu discloses using dynamic programming. 

Regarding claim 13, section 5 of Tu disclose using global nonlinear optimization. 

Regarding claim 15, please see section 3.3 of Tu as it discloses all aspects of 
claim 15. 

3. Claims 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over Zickler 
in view of Tu in further view of Saund (5835241). 

Regarding claim 14, neither Zickler nor Tu discloses using a parametric model. 
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Saund discloses using a parametric model (see column lines 14-42). 

It would have been obvious at the time of the invention to one of ordinary skill in 
the art to include in Zickler and Tu a parametric model means as taught by Zickler. The 
reason for the combination is because it makes for a more robust system that can store 
data by using less memory. 

Allowable Subject Matter 

4. Claims 16-29, 33, and 35 are allowed. 



Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Hadi Akhavannik whose telephone number is 571-272- 
8622. The examiner can normally be reached on 10:30-7:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bhavesh M. Mehta can be reached on (571)272-7453. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more infomriation about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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